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Abstract 

The purpose of this short paper dedicated to the 60th anniversary of Prof.Constantin 
Tsalhs is to show how the use of mathematical tools and physical concepts intro- 
duced by Burr, Levy and Tsallis open a new line of analysis of the old problem of 
non-Debye decay and universality of relaxation. We also show how a finite charac- 
teristic time scale can be expressed in terms of a g-expectation using the concept of 
q- escort probability.The comparison with the Weron et al. probabilistic theory of 
relaxation leads to a better understanding of the stochastic properties underlying 
the Tsallis entropy concept. 
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1 Maximum entropy principle and probability distributions 



Most of the probability distributions used in natural, biological, social and 
economic sciences can be formally derived by maximizing the entropy with 
adequate constraints {maxS principle) [1]. 

According to the maxS principle, given some partial information about a ran- 
dom variable i.e. the knowledge of related macroscopic measurable quantities 
(macroscopic observables) , one should choose for it the probability distribution 
that is consistent with that information but has otherwise a maximum uncer- 
tainty. In usual thermodynamics, the temperature is a macroscopic observable 
and the distribution functions are exponentials. 

Quite generally, one maximizes the Shannon-Boltzmann (S-B) entropy: 

S = - [' f{x)\nf{x)dx (1) 
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subject to the conditions 



rb rb 

/ f{x)dx = l, / gi{x)f{x)dx =< gi{x) >, i = l,2,.... (2) 

J a J a 

Both hmits a and b may be finite or infinite. The functions gi{x) whose expec- 
tation value have been usually considered [1] as constraints to build probability 
distributions are of the type 

X, x'^, x"', {x— < X >y, \ X \,\ X— < X >\,\nx, (Inx)^, ln(l ± a;), exp(— a;).... 

(3) 

The maximum entropy probability density function (mepdf) depends on the 
choice of the limits of integration a and b and the functions gi{x) whose ex- 
pectation values are prescribed. 

One constructs the Lagrangian 

L = - f' f{x)ln{f{x)dx 



rb rb 

-Ao(/ f{x)dx-l) gi{x)f{x)dx- < gi{x) >) (4) 

J a ^ J a 

and differentiating with respect to f{x) the method of Lagrange multiliers 
leads to : 



/(x) = Cexp[-^ Ai5fi(a;)] (5) 

i 

The factor C is a normalization constant and the Lagrange parameters Aj 
are determined by using the constraints (3). When this cannot be achieved 
simply, the parameters Aj are parameters defined by the constraints. Most 
distributions derived from the constraints given in (3) posses finite second 
moments and hence belong to the domain of attraction of the normal distri- 
butions. Those which belong to the domain of attraction of the Levy (stable) 
distribution i.e. the Cauchy and the Pareto distributions are obtained with a 
characteristic Levy tail parameter (not to be confused with the exponent a 
used in the constraints) defined by Pr{^i > xt) — x~°'^Pr{^i > t), in the range 
1 < CiL < 2.[1] indicating that only a finite expectation value (first moment) 
can be defined. 

The following example is relevant for non-Debye relaxations. If we derive the 
mepdf f{x) of the random variable X defined in the range (0, oo) and if we 
maximize the S-B entropy subject to the two constraints 

roo roo 

Kx^'y =/ x'^f{x)dx <\nx> =/ {\nx)f{x)dx (6) 

Jo Jo 
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using the Lagrange variational method, it can be shown easily that the fol- 
lowing mepdf 

/W^— oxp|-(j^)l (7) 
maximizes the S-B-entropy [1] provided 

-Aalna; = Inx"-^ (8) 

In that case, if we chose < >= 1 as the natural scale of the problem the 
exponent a is related to In x as 

<lnx>=-7/Q; (9) 

where 7 = r'(l) = 0.577215... is the Euler constant. 

The WeibuU distribution function is given by 

roo 

F(x) = / f(x')dx' = 1 - exp(-x"/ < x" >) 
Jo 

As it is well known the WeibuU distribution which is used in many physical 
problems exhibits a power law behavior F{x) — x°' for x — > 0. For a < 1, 
The Williams- Watts formula (stretched exponential) used for decades to fit 
the non-Debye relaxation function in the time domain[2]. 



2 Maximization with Tsallis entropy 



A generalization of the S-B entropy is appropriate when the phenomena (phys- 
ical, biological, economical...) are described by distributions with a Levy char- 
acteristic parameter < 1. Here we will start from the Tsallis non-extensive 
entropy 

Sq-- f fl{x)\TigU{x)dx (10) 

Ja 

subject to the conditions 



rb 

/ fq{x)dx 
Ja 



rb 

L, J 9qn {X)fq{x)dx =< gq^i{x) >g, 1 



1,2, 



i:mx)dx 



!yfi'\x)dx 



;i2) 
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The function fq{x) is the so-called "escort" probabihty [3] [4] . Both hmits of 
integration a and b may be finite or infinite. To generalize what has been done 
with the standard S-B. entropy we can consider the constraints (3) using the 
generalized g-exponential and g-logarithm functions (g-constraints). 



— 1 _i_ 
IriqX = expq(x) = [1 + (1 — q)xY-i with ln^(expg(a;)) = x 

^ (13) 
The mepdf depends on the choice of a and b and the functions whose expec- 
tation values are prescribed. 

One constructs the Lagrangian 

rOQ 

Lq^- fq{x) In fq{x)dx- 

J 



f OO /' 'CXD 

-Ao( j fq{x)dx - 1) - X! \,i ( J 9q,i{^)ifq{^)dx- < Qqiix) >q) (14) 
i ^ 

and differentiating with respect to fq{x) one finds 

fq{x) = C^expJ- ^ \q,igq,i{x)\ (15) 
i 

fq(x) = CqfqixY (16) 

The factors Cq are normalization constants and the Lagrange parameters Xq^i 
are determined by using the g-constraints (11). When this cannot be achieved 
simply, the parameters Aj are parameters defined by these constraints. 

Here we will derive the mepdf fq{x) of the random variable X generalizing 
the two constraints (6) leading to the WeibuU distribution 

< 91 (17) 

< lOgg X >q= §2 

Using the properties of lng(a;)and expg{x), we obtain easily the generalization 
of the WeibuU distribution as a generalized Pareto law (BurrXII : Bh^^ix) ~ 
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1 - {l + x'')-", x>0 [5] [6] 



- ^ (|^>^r- (18) 

-A2 In, X = (1 + (1 - g) Aix") In, x"-^ (20) 

which tends to (8) for g — > 1. If the natural scale < >,= 1, one can obtain 
for that case the following result: 



provided 



(1 - 9)(2 - 9)r(f5f ) 

If 5 ^ 1, < Ingx" >g— >^ —7 which is the result (9) obtained for the WeibuU 
distribution. For < g < 2 this distribution belongs to the domain of 

attraction of the one-sided Levy-stable law since we have 



lini ^ ^''^f^^ = x-"^ (22) 

with the heavy tail index 



2 - g 

aL = a < 1 (23) 

q- 1 

In the limit q — > 1, we recover the stretched exponential Williams- Watts 
formula. 



3 Universality in non-Debye releixation 



This result can be used to represent non-Debye relaxation if we identify the 
random variable X with the macroscopic waiting time © as defined by Weron 
ei.aZ.[7][8][9]. We have : 

Fe{t) = PT{e <t) = jj{s)ds = 1 - [1 + (fr^)^^]"^ (24) 

The relaxation function (pit) can be written as the survival probability of the 
non equilibrium initial state of the relaxing system. Its value is determined by 
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the probability that the system as a whole will not make transition out of its 
original state until time t : 



2-2 
9-1 



(25) 



2-q' <h>q 



This expression has the form of one of the universal relaxation functions pro- 
posed in [7] [8] as result of an elaborate study of the stochastic mechanisms 
underlying relaxation dynamics in non Debye complex systems. 



with < q; < 1 and k> a. 

The equivalence of the two formulas allows us to relate the parameter k with 
the non-extensive parameter q : 



This relation was already derived in [10]. In the limit q — * l,we recover the 
stretched exponential Williams- Watts formula used to fit the time-domain 
relaxation data [11] [2]. 

The g-dependent scale parameter A which is related to the the peak fre- 
quency ujp of the response function in the frequency domain is materials and 
g— dependent and is now simply related to the escort probability average 



and becomes the natural finite time scale in a physical system (for example 
the dipolar relaxation) which " choose" [7] the regime where the usual average 
of the waiting time is infinite i.e. a/k < 1. 

We can write the response function 



(i)w{t) = [i + k{Atr]-'^' 



(26) 



(28) 




(29) 



aA{At) 



for At «1 



fa{t,kw) 



(30) 



aAk-^-^/''{Aty/''-^ for At » 1 



6 



and in the frequency range, where 



X{uj) = / exp[-tu;t]f{t)dt = x'(^) + ^X (^) (31) 
Jo 

obeys the Jonscher universal laws [12] [13] 

lim ^^4^ = cot(n7r/2) lim , = tan(m-) (32) 

with n=l — a, m — a/k and A; = 

The /i-moment of the BurrX// distribution diverges if m = a/k < h. There- 
fore the expectation value of the random variable diverges if m < 1 or 

^ l+a 

In the case of dipolar systems, most of the empirical data for the power-law 
exponents n and m are in the range [0,1] and can be accounted for using 
the heavy-tailed ButtXII waiting-time distribution with a/k < 1 for which 
< 9 >= oo. 



This presentation which avoids the usual weighted average of a Debye response 
function over a relaxation time or relaxation rate distribution confirms the re- 
lation obtained between the empirical exponents n and m and the "fractal" 
exponent a and the nonextensive exponent q derived by two of us [10] using 
more phenomenological arguments. In that model the cluster volume distribu- 
tion was obtained from the max Sg principle and a " fractal" relation between 
the cluster volume and its relaxation time was assumed. 



The BurrX// distribution can be obtained as a smooth mixture of WeibuU dis- 
tributions compounded with respect to a random scale parameter distributed 
with the gamma distribution [6]. Using this fact we can rewrite (25) as 



ct>a,,{t) = / exp(-A"i")ciri/,,fe(A7A") (33) 

J 

where 

rv..(A"M") = ^f (2)'/'-'e-/M|) (34) 

is the generalized gamma distribution with scale parameter k and form factor 
a = 1/k. [7]. It is however to be noticed that this procedure leads to a relax- 
ation function with a A factor defined as a usual (g = 1) expectation value. 
By contrast the max^g principle allows to define /I as a natural scale in a 
situation where the expectation value cannot be defined. 
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4 Stochastic theory and TsaUis entropy 

The discussion of the equivalence of the two results obtained for the "uni- 
versal" relaxation function (25) and(26) from the max5'q method and the 

Weron et al. stochastic theory [7] [8] can lead to a better understanding of 
the stochastic properties underlying the Tsallis entropy concept as well as its 
possible generalization for more complex spatio-temporal dynamical systems. 

The starting point is the observation of the fact that the relaxation function 
for the whole system i.e its survival probability is just the probability of its 
first passage 

(l>{t) = Pr(^ >t)^ Pr(min(^ijv ^.^,iv ) (35) 

where 

P^{OiN > t) =< e-^'^* > (36) 



(Pit) = n;'^'^ Pr(^,^ >t) = n;'~'^ Prie-'^^^' > t) =< exp{-PNt) > (37) 
with 

UN 

/3i,N 

Pn = — (38) 

The quantity is a random relaxation rate corresponding to the whole (macro- 
scopic) system. The random relaxation rates Pi^N and random waiting times 
6i^N are related to the relaxations of the local individual entities. is the 
number of total entities (atoms, molecules, dynamical clusters) able to relax, 
is the number of relaxing entities participating effectively in the relaxing 
process . It is important to notice that vn can be a fixed number or a random 
quantity. 

The distribution of (38) can be approximated by the weak limit 

(3 = lim (ajv)"^/9jv (39) 

AT— ►oo 

where ojv is the sequence of relevant normalizing constants. On the basis of 
limit theorems of probability theory, it is possible to define the distribution of 
the limit (39) even if the distribution of the individual relaxation rates f3i^N 
and the number of i^n of entities participating effectively in the relaxation 
process are known to a relatively limited extend only. 
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The macroscopic relaxing properties are clearly related to the probability dis- 
tribution of the summand f3 (39) . In the case of a deterministic fixed number 
of relaxing entities, Weron etal. [7] [8]have demonstrated, using the extremal 
value theorem, that if the 9 are distributed with a stretched exponential dis- 
tribution, the only possible distribution for /3 is a one-sided stable Levy dis- 
tribution with index < a < 1 and we have: 



/•oo 

Pr(^ >t)= e-^dLf^ib) = e-(^*)" (40) 

Using an heuristic argument one can understand physically that if the smallest 
local waiting time determines the macroscopic relaxation, this should corre- 
spond to the largest relaxation rate. It is not therefore surprising that the 
distribution dominated by the highest terms in (38) is for N— ^ cxd the stable 
one-sided Levy distributions which has the property to be dominated asymp- 
totically by the highest term [15] [14]. 

If the number i/^ is a random variable, the scale parameter is a random vari- 
able and the BurrX// distribution is obtained if the scale distribution is the 
generalized gamma distribution (34). It can be easily shown by randomizing 
the scale parameter in (33) that 



Pr{9 >t)= e-^'dF-p{h) = 1 - B^^^)f^{k^''' At) = [l + k [Aty]-^'^ (41) 

J 

where F^{b) is the Mittag-Lefiler distribution. In that case ;9 is a stable 
random variable and stochastic theory arguments show that this result is 
obtained if vn is distributed with a generalized negative binomial distribution 
17). 



5 Conclusions 



In the case of non-Debye relaxation, the short-range interactions, geometric 
and dynamic correlations can be accounted for by maximizing the S-B entropy 

with adequate constraints. The small clusters and short-time relaxation can 
be described by a stretched exponential relaxation function. The exponent 
a < 1 introduced in the constraints is a measure of the " non-idealness" of 
the relaxation processes at this scale (fluctuations of the size and intra-cluster 
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interactions). The system is extensive in the fractal time domain t" and the 
distribution of the relaxation rates(/9) is heavy-tailed with a Levy tail exponent 
equal to a. 

Larger clusters relaxation and long time power law relaxation can be obtained 
by the maxSq principle and depends on the exponent a/k with k = The 
q non- extensivity parameter and the heavy tail properties of the waiting-time 
(6) distribution are directly related to the random number of relaxing entities 
at the meso-or microscopic level which gives rise to fluctuations of the usual 
extensive (i.e.corresponding to exponential distributions) time scale. In that 
sense the Tsallis entropy can be viewed as a technique to define a finite macro- 
scopic scale when the number of entities participating to the spatio-temporal 
dynamical process is statistically fluctuating due to natural geometric and 
dynamical constraints. That scale can be defined as a g-expectation value us- 
ing the concept of escort probability. This situation is typical of "frustrated" 
systems like glasses, polymers and porous materials. 

Although our discussion has been limited to dipolar relaxation, our conclusions 
are relevant to a great number of non-exponential decay phenomena observed 
in nature [16] [17]. 
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